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Min-max  bias  robust  M-estimates  of  scale  are  obtained  for  positive  random 

variables  which  have  ^-contaminated  distributions.  Any  such  estimate  is  a  scaled 

„  , 

,  /  (>•  ■ 

order  statistic,  with  the  order  statistic  determined  by  £ .  As  $  -4T).5  the  min-max 
bias  robust  estimate  becomes  a  scaled  sample  median,  which  thereby  enjoys  both 

high  breakdown  point  of  0.5  and  min-max  bias  robustness.  Furthermore,  for  a 

*1‘ ,  '  ' 

wide  range  of  £ ,  min-max  estimate  is  quite  close  to  the  scaled  median  in  terms  of 

both  structure  and  min-max  bias  behavior.  Results  are  also  obtained  for  random 

.  '  r  -  '  i  »  ;  1 ' '  '  '  ■  c 

variables  whose  distribution  is  F  =  (  \  -  $) F^  +  $H  with  F«  symmetric  about  an 
unknown  location  parameter.  In  particular  we  show  that  when  F o  is  normal  and 
0 .35 ,  the  min-max  bias  M-estimate  of  scale  is  a  scaled  order  statistic  applied 
to  the  absolute  value  of  centered  data,  with  the  median  as  the  centering  estimate. 
This  estimate  is  extremely  close  to  a  scaled  median  absolute  deviation  about  the 


median,  in  terms  of  both  structure  and  bias  behavior. 
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1.  INTRODUCTION 


In  a  somewhat  neglected  section  of  his  by  now  classic  paper,  Huber  (1964)  considered 
the  problem  of  minimizing  the  maximum  asymptotic  bias  of  translation  equivariant  location 
estimates  over  e-contaminated  models  with  asymmetric  contamination.  Huber  showed  that 
the  sample  median  solves  this  problem.  He  also  downplayed  the  significance  of  the  result 
and  concentrated  on  the  “deeper  theory”  of  min-max  variance  robustness  over  symmetric 
neighborhoods  (see  Section  4.3, 4.4  of  Huber,  1981). 

In  spite  of  substantial  awareness  of  the  importance  of  controlling  bias  due  to 
contamination,  and  other  deviations  from  the  nominal  model,  the  literature  is  relatively 
devoid  of  global  results  on  this  robustness  problem.  Hampel’s  optimal  bounded  influence 
estimates  (see  Hampel  et  al.,  1986,  and  references  therein)  control  bias  only  for  vanishingly 
small  fractions  of  contamination,  and  the  shrinking  "Jn  -neighborhood  approach  (see  Jaeckel, 
1971,  Bickel,  1984  and  references  in  the  latter)  is  also  local  in  nature.  The  main  global 
approach  to  robustness  has  been  the  construction  of  high  breakdown  point  estimates  for 
multi-dimensional  problems.  Interesting  recent  results  along  these  lines  may  be  found  in 
Donoho  (1982),  Donoho  and  Huber  (1983),  Rousseeuw  (1984),  Rousseeuw  and  Yohai 
(1984),  Yohai  (1986),  Hampel  et  al.  (1986),  Yohai  and  Zamar  (1986). 

It  should  be  noted  that  the  problem  of  bias  robustness  and  the  desirability  of  optimal 
bias  robust  estimators,  namely  min-max  bias  estimates,  is  clearly  recognized  in  Hampel  et 
al.,  (1986,  Table  2A,  p.  176)  where  the  term  “most  B  -robust”  is  used.  We  are  also  aware  of 
very  recent  work  on  bias  robustness  by  Donoho  and  Liu  (1986),  who  demonstrate  attractive 
properties  of  minimum  distance  estimators  in  this  regard. 

In  the  present  paper  we  take  a  small  step  beyond  Huber’s  (1964)  early  results  by 
constructing  min-max  bias  robust  estimates  of  scale  using  M-estimates  and  E-contaminated 
distributions.  An  M-estimate  of  scale  for  positive  random  variables  X, ,  is  defined  as 
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for  an  appropriate  function  X-  We  shall  work  with  monotone  X  which  satisfy  A1-A3 
stated  in  Section  2.1.  The  general  definition  (1.1)  is  needed  to  handle  x  which  are 
discontinuous.  If  X  is  continuous,  then  will  satisfy 


f  \ 


and  sn  will  be  unique  when  x  is  strictly  increasing  on  { t :  x(t)<Lb  } . 

The  positive  random  variables  X ,  are  assumed  to  be  independent  and  identically 
distributed,  with  common  distribution  F  belonging  to  the  e-contaminated  family 


F  =  {F  :  F  =(l-e)F0  +  e//} 


(1.2) 


where  H  is  any  distribution  function  and  0  <  £  <  1 ,  e  fixed.  In  a  later  section  of  the  paper, 
this  setup  is  modified  somewhat  to  deal  with  the  case  of  random  variables  X,  which  have  a 
nominal  distribution  which  is  symmetric  about  an  unknown  location  parameter. 

Estimation  of  scale  is  an  asymmetric  problem  with  regard  to  bias.  Outliers  give  rise  to 
asymptotic  positive  bias  whose  maximum  positive  value  is  denoted  by  B+(x),  whereas 
inliers  result  in  a  negative  bias  whose  maximum  absolute  value  is  denoted  by  B~(x)- 
These  biases  are  related  to  the  minimum  and  maximum  asymptotic  values  of  the  scale 
estimate,  s+(X)  and  j"(x)»  by  -s+(X)  =  1  +  F+(X)  10(1  J~(X)  =  1  ~B~(X)> 

respectively. 

In  general  B  *(  x )  *  B  “( x ) ,  and  this  asymmetry  leads  one  to  introduce  a  loss  function 
I  ( ^~(X)>5+(X))  =  I  ( B~(x ),  fi*(X))  to  minimized  with  respect  to  the  choice  of  x. 
thereby  resulting  in  a  min-max  bias  estimate.  We  shall  call  any  such  estimate  a  bias-robust 
estimate. 


It  came  as  a  pleasant  surprise  to  find  that  the  maximal  biases  B+(x)  and  B~(x),  or 
equivalently,  the  minimal  and  maximal  scales  .r+(x)  =  l+fi+(X)»  S~(X)=  1-B~(X)» 
can  be  obtained  in  a  manageable  analytic  forms.  It  is  this  manageability  which  allowed  us  to 
minimize  /  ( s~(X)f  S  +  (X))>  and  thereby  obtain  bias  robust  estimates  for  certain  classes  of 
loss  functions. 

Section  2  of  the  paper  presents  the  basic  theory  for  the  contamination  model  (1.2)  for 
positive  random  variables.  In  Section  2.1  we  show  that  it  suffices  to  work  with  point  mass 
contaminations.  In  Section  2.2  we  establish  the  maximal  and  minimal  scale  expressions 
(2. 10) — (2. 1 1)  for  s+(x),  s~(x),  which  are  of  value  in  their  own  right  for  calculating  the 
maximal  biases  of  any  scale  M -estimate.  Section  2.3  proves  the  pleasant  result  that  s+(x) 
is  minimized  and  s"(x)  is  simultaneously  maximized  by  a  x  of  0-1  jump  function  type, 
Xa »  with  jump  location  a  .  The  resulting  estimate  is  a  scaled  order  statistic.  This  result  is 
then  used  in  Section  2.4  to  establish  the  optimal  choice  of  a  for  loss  functions  /  of  a  fairly 
general  form.  In  Section  2.5,  the  breakdown  point  of  the  bias  robust  estimates  is  exhibited. 
It  is  shown  that  as  e  — >  0.5 ,  the  min-max  bias  robust  estimate  is  a  scaled  median,  which  has 
breakdown  point  0.5 .  Thus  the  scaled  median  enjoys  two  global  robustness  properties 
simultaneously. 

Section  3  provides  some  explicit  bias,  breakdown  point  and  efficiency  calculations  for 
the  cases  of  exponential  and  positive  normal  F0 .  It  turns  out  that  for  a  wide  range  of 
contamination  fractions,  the  bias  robust  estimate  is  quite  close  to  the  scaled  median,  both  in 
form  and  with  regard  to  actual  bias ! 

Section  4  briefly  treats  maximal  bias  curves,  and  also  the  issue  of  the  finite-sample  size 
relevance  of  our  asymptotic  theory. 

Finally,  Section  5  treats  the  case  of  estimating  the  scale  of  distributions  which  are 
symmetric  about  an  unknown  location  parameter.  The  problem  is  now  considerably  more 
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complicated,  but  we  nonetheless  show  that  jump-function  type  M-esdmates  are  again 
optimal  under  certain  conditions.  For  the  case  of  normal  F0  we  are  able  to  establish  bias 
optimality  for  the  range  0£e£.35.  The  bias  optimal  estimate  uses  the  median  for 
centering,  and  is  very  close  to  the  well-known  scaled  (for  Fisher  consistency)  median- 
absolute  deviation  about  the  median  (MADM)  estimate,  both  in  form  and  with  regard  to  bias 
performance.  Thus  the  scaled  MADM  is  very  nearly  optimal  with  regard  to  both  breakdown 
point  and  bias. 

Proofs  are  provided  in  the  body  of  the  paper  for  the  key  results,  whereas  proofs  of  lesser 
results  are  relegated  to  Section  6. 


2.  THE  GENERAL  SCALE  PROBLEM 


2.1  M-estimate  Scale  Functionals  for  Contamination  Models 

The  asymptotic  value  of  ,  defined  by  (1.1),  is 


s(X>F)  =  1 


5:  Jx(7)df(x)^b 


The  constant  b  will  always  be  determined  by  Fq  and  x  as 

*  =  £/a<*>  • 


F  e  F  . 


(2.1) 


(2.2) 


which  insures  Fisher  consistency:  j(F0,  x )  =  1 . 

We  shall  work  with  the  class  C  of  x  functions  which  satisfy  the  following  conditions: 


(Al)  x  «  nondecreasing  and  bounded  on  [0,°°),  with  at  most  a  finite  number  of 
discontinuities,  and  %  (0)  =  0- 

(A2)  x  is  such  that  b  =  b  (x )  satisfies  the  inequalities  e  <  b  <  1  -e 
In  view  of  (Al)  and  (2. 1)— (2.2),  there  is  no  loss  of  generality  in  making  the  assumption 

(A3)  sup,  x  (*)=!• 


Lemma  2.1:  Under  (A1)-(A3)  the  asymptotic  equation  (2.1)  has  a  unique  solution 
s  =  s  ( x .  F )  €  (0, «»)  for  any  F  e  F ,  including  the  case  where  H  is  a  point  mass  5„  at 
+°<>  or  50  at  0. 

REMARK  2.1:  It  is  easy  to  see  that  for  any  unbounded  x>  ^(X.  F)  =  »,  when  H  =  8„. 
Thus,  boundedness  of  x  is  a  necessary  (but  not  sufficient)  condition  to  obtain  a  bounded 
bias  over  F. 
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REMARK  22:  The  proof  of  Lemma  2.1  shows  that  if  b  =  1  -e,  then  (2.1)  will  have  only 
the  solution  s  =  0  when  H  is  concentrated  at  the  origin.  This  constitutes  (implosive) 
breakdown  of  the  estimate  due  to  inliers.  The  proof  also  reveals  that  if  b  =  e  and  H  is  a 
point  mass  at  infinity,  then  s  =  «®  is  the  only  solution  and  we  have  (explosive)  breakdown 
due  to  outliers.  See  Hampel  (1971),  Huber  (1981)  and  Donoho  and  Huber  (1983)  for  various 
definitions  of  breakdown  point. 

Consider  the  family  of  point-mass  contaminations 

Fi  =  {F  :  F  =  (l -e)F0 +e8y ,  y  e  R  +  } 

were  dy  is  a  point  mass  at  y  and  R+  is  the  set  of  extended  nonnegative  real  numbers. 
The  following  lemma  shows  that  the  maximum  and  minimum  biases  over  F  are  achieved 
over  the  smaller  subfamily  F!  . 

Lemma  22:  Suppose  (A  1)  and  (A2)  hold.  Then 

inffeF,  J  (X.^)  =  inf/r€F*  (X.*7) 
and 

suPfeF,  s  (X./7)  =  sup/6F5  (x,/7) 

i 
1 

2.2  Minimum  and  Maximum  Scale  Functionals 

Since  it  suffices  to  work  with  F  in  Ft  ,  it  is  convenient  to  replace  s(x.  E)  by  either 
s  ( X  >  y )  >  or  more  simply  sy  ,  where  y  is  the  location  of  the  contamination  point  mass  by  . 
Let 

s+(X)  =  supy205(X.>')  (2.3) 
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denote  the  maximal  scale,  and  let 

s~(x)  =  inf,*,  s(x,y). 

denote  the  minimal  scale.  Then  the  maximum  positive  bias  of  s(x,  F)  over  F  is 

B+  =  *+(X)-l 

and  the  maximum  of  the  absolute  values  of  the  negative  bias  is 

B~  =  l-s'(x)  ■ 


hy(s)  =  fx(— )dF0(x)  ,  0 <s  <°°  (2.7) 

0  5 

and  note  that  for  F  e  Fj ,  and  any  j  >s(x,y )  we  have 

(l-e)Ms)  +  ex(Z)-fr  <;  0.  (2.8) 

*  s 

where  b  =h%(  1).  It  is  easy  to  see  that  hx  is  continuous,  non-negative  and  strictly 
decreasing,  with  lim^g  hx(s)  =  1 ,  lim^,*,  hx(s)  =  0.  When  x  is  continuous,  so  that  sy 
solves  (2.8)  with  equality,  the  following  result  is  almost  immediate. 

Theorem  2.1:  Suppose  that  (Al)  and  (A2)  hold.  Then 

=  (2’9) 


with  5+(X)  achieved  by  point  mass  contamination  8^,  with  y 
by  point  mass  contamination  5q  at  the  origin. 


(2.10) 


•  <» ,  and  s  ( x )  achieved 
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2.3  Optimality  of  Jump  Function  %’s 

We  now  suppose  that  F0  has  a  density  /0 .  Consider  the  jump  function  type  %  given 
by 

f  1  I*  I  >a 

\  (x)  =  jo  |ac  |  <  a  .  (211) 

When  %  in  (1.1)  is  a  jump  function  %  ,  the  estimate  sn  is  a  scaled  order  statistic: 

a 

1  V 

-  -*(n-[nb))  • 

Fix  be  ( e,  1  -  e) ,  and  let 

oo 

Cfc  =  {%:%eC  and  J  %(x)/0(x)dx  =b]  (2.12) 

o 

The  following  lemma  shows  that  if  a  is  appropriately  chosen,  then  for  a  large  class  of 

densities  /0  ,  %  minimizes  the  maximal  scale  s+  =  s+(%)  over  Cb  ,  and  simultaneously 
a 

maximizes  the  minimal  scale  s  ~  =  s  “( % ) ! 


Lemma  2.3 :  Let  a  satisfy 

1  -F0(a)  =  b 

and  suppose  that  F0  has  a  positive  density  /q  with  the  property  that 
decreasing  in  x  for  s  >  1  and  increasing  in  x  for  s  <  1 .  Then  for  every  s  £  1 


(2.13) 


fp(sx)  . 

/o(*) 


is 


and  for  every  s  <  1 


h%  (5)  £  hx(s)  v  XeC6. 

a 


hy  (s)  >  hy(s)  ^  %e  Cb  . 


(2.14) 


(2.15) 
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Proof:  x  is  a  member  of  Cb  by  virtue  of  (2.13).  For  every  X€  we  have 
a 


jx(x)fo(x)dx  =  \[\-Xix)\fQ{x)dx  .  ' 

0  a  { 

i 

i 

Then  for  s  t  1  we  have 


r  t  fo(sx ) 

s  jx(x)  f0(sx)dx  =  s  \x(x)fo(x)  7TT 
0  0  Jo(X) 

fo(sa)  a. 

Z  i  V7-r/x(Jt)/oU)<fc 

fo(sa)  “ 

=  *  -V-—  /[l-xUH/oOO* 

/0(a)  a 


>  ^  J  [  \-x(x)]fo(sx)dx  . 


Then  for  every  %  €  Cfc  and  for  every  jSI  we  have 


hx(s)  =  s  j  x(x)fo(xs)dx  Z  sjx  (*)fo(sx)dx  .  =  h%  (s). 
o  o  a  a 

For  s  <  1 ,  the  above  inequalities  are  reversed.  D 


Lemma  2.4:  Suppose  that  fo(x)  is  non-increasing,  differentiable,  and  that  -log/0(x)is 
convex.  Then  the  hypotheses  of  Lemma  2.3  are  satisfied. 


REMARK  2.3:  The  exponential  and  positive  normal  distributions  treated  in  Section  3  satisfy 
Lemma  2.4. 


REMARK  2.4:  The  M  -estimate  of  scale  based  on  x  is  a  maximum-likelihood  estimate 

a 

(M.L.E.)  of  scale  based  on  a  density  having  the  form 


I 


/*<*,  =  t. 


0<  x  <  a 


x  >a 


where  t>0  satisfies  t3+T2a2-a=0.  Of  course  bounded  x’s  can  only  arise  from 
M.L.E.’s  for  densities  having  tails  at  least  as  heavy  as  the  Cauchy  tails  of  /*.  While  the 
distribution  F  *  corresponding  to  /  *  is  not  a  member  of  F ,  there  is  no  particular  reason 
that  it  should  be  for  the  problem  we  are  treating. 


a  =  F0  1  (£) 


(2.16) 


a  =  F0_1  (1  -e)  . 


(2.17) 


Then  in  view  of  (2. 13)  and  (A2),  the  jump  point  a  of  the  jump  function  x  must  satisfy 

a 


a  <  a  <  a  . 


(2.18) 


For  X  =  X  ,  let  .s+(o)  =  s+(x  )  and  s  (a)  =5  (x  h  and  note  that 
a  a  a 


hx  {s)~  \  -F0(sa).  Thus  (2.9)  and  (2. 10)  give 


•*«0  -  ^0-  ^ 


(2.19) 


1  „_i  F0(a)-£ 

5  (a)  =  —  Fq 

a  1  -E 


(2.19’) 


Note  that  as  a  T  a  ,  s  +(a )  — »  °o  and  breakdown  due  to  outliers  occurs.  On  the  other 
hand,  when  a  ia,i'(a)-)0  and  breakdown  due  to  inliers  occurs.  For  a  e  (a,  a  )  we 


clearly  have  0  <  s  ( a )  <  1  and  1  <  s  +( a ,  <  oo . 


For  some  distributions  F0 ,  it  may  turn  out  that  s+(a)  and  s~(a)  are  both  monotone 
increasing  functions  of  a  (this  is  the  case  for  example  when  F0  is  the  exponential 
distribution  treated  in  Section  3).  In  such  cases  we  wish  to  choose  a  small  in  order  to  make 
the  maximal  scale  s+(a)  and  the  maximum  positive  bias  s  +( a )  - 1  small.  At  the  same 
time  one  wishes  to  choose  a  large  to  make  the  minimal  scale  s~(a)  large,  thereby  making 
maximum  negative  bias  l-r“(a)  small.  The  precise  choice  of  a  will  depend  upon  the 
loss  function  used  to  assess  bias. 


2.4  Min-Max  Bias  Results  for  Certain  Loss  Functions 

Bias  in  scale  estimation  is  a  fundamentally  asymmetric  problem,  and  one  may  wish  to 
consider  any  of  a  variety  of  loss  functions  /  =  /  (s  ",  s  *) .  Most  loss  functions  of  interest  will 
assign  infinite  loss  to  j+  =  «»  or  s~  =  0.  Some  possibilities  are,  for  0  <  £  1  ^  s+  <  «>: 

(i)  /(s~,s+)  =  (5-r1+^+-2 

(ii)  l(s~,s+)  =  log  5  +  —  log  s ~ 

(iii)  l(s~,s+)  =  max{(5-)_I,s+} 

(iv)  l(s~,s+ )  =  max  {-logs~,  logj*} 

Since  several  considerations  lead  one  to  the  logarithmic  transformation  when  estimating 
scale,  the  choices  (ii)  and  (iv)  may  be  particularly  appealing. 

The  above  possibilities  suggest  consideration  of  two  distinct  classes  of  loss  functions. 
Lt:  All  continuous  functions  /(« ltu2)  on  (0,l]x[l,oo)  which  are  decreasing  in 
u  j,  increasing  in  u  2 ,  and  such  that  limu_)Q/(u1,u2)  =  °°  for  each  real  u2, 

and  limu  i_>00/(M1,M2)  =  °°  for  each  real  «j. 

Lj.  All  functions  on  ( 0, 1]  x  [  1 ,  °°)  of  the  form 

/  ( u  i ,  u  2)  =  max  {  g  i  (  m  i ),  g  2(  u  2) }  where  g\  and  g2  are  continuous  with 
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g  t  strictly  monotone  decreasing,  g  2  strictly  monotone  increasing,  and 
fon«,-»oS  i(“i)=  «2(“2)=  °°- 

While  L2  is  a  special  case  of  Lj ,  Lj  has  enough  additional  structure  to  warrant 
separate  treatment  Note  that  for  /  in  or  L2,  /(r“(X)»  •S+(X))  represents  the 
maximum  loss,  accounting  for  both  positive  and  negative  bias,  due  to  use  of  a  particular  x  - 
Let 

L(a)  =  l(s~(a),s+(a))  =  l(s~(X  ),  *+(X  )) 

a  a 

denote  the  value  of  the  loss  for  a  jump  function  x 


Theorem  2.2:  Suppose  that  l  e  L, ,  i  =  1,  or  i  =  2.  Then  under  the  assumptions  of 
Lemma  2.3,  for  i  =  1,2 


exists,  and 


a 0  =  argmin  L(a) 
a  €  (.a,a) 


L(a0 )  =  min  l(s ~(x),  s*(x))  ■ 

X€  c 

Proof:  Since  F  0  is  not  only  absolutely  continuous,  but  also  strictly  increasing,  Fq  1 
exists  and  is  continuous.  Thus  r'(a)  and  s+(a)  are  continuous  functions  of  a. 
Furthermore,  s~(a)—>  0  as  a  la  sfo"1^)  and  s+(a)— *00  as  a  Ta  =  Fq  1  ( 1  —  e) . 
Thus  L(a)~*  00  as  a  ia  or  at?  and  since  L(a)  is  continuous,  its  minimum  a0  is 
attained  on  a  closed  subset  of  (a,  a  ) .  It  follows  from  Lemma  2.3  and  the  properties  of  L 
that  for  each  b  e  (e,  1  -  e) ,  and  correspondingly  each  a  e  ( a ,  a  ) ,  L  (5  '( x ),  s  +( x ))  is 
minimized  by  the  jump  function  x  .with  a  determined  by  (2.13).  0 
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Corollary  22:  Let  /  e  L2,  and  let  a0  be  the  optimal  a  of  the  theorem. 

(i)  Either  a0  satisfies  the  equation 

$i(s"(ao))  =  S2(s+(ao ))  •  (2.20) 

or  a  0  is  a  local  minimum  of  at  least  one  of  the  functions  s  “( a ),  s+(a). 

(ii)  If  s~(a)  and  s+(a)  are  both  strictly  monotone  increasing,  then  a0  uniquely 
satisfies  (2.20). 


Proof:  (i)  Suppose  that  a0  does  not  satisfy  (2.20).  Then  there  is  a  neighborhood 
(a0-5,a0+5)  such  that  either  l(a)=  g  {(s~(a))  or  l(a)=  g2(s+(a))  on 
(a0-8,a  o+5).  Then  by  definition  of  a  0  it  must  be  a  local  minimum  of  either  s  ~(a)  or 
s+(a). 

(ii)  g  j(j_(a))  is  a  strictly  decreasing  function  of  a  ,  which  tends  to  +«>  as  ala, 
while  g  2(s  +(a ))  is  a  monotone  increasing  function  of  a  strictly  tends  to  +  °°  as  a  T  a  . 
Thus  the  equation  g  t( s  ~{a  ))=g  2(s  +(a ))  has  a  unique  solution  a  0  e  ( a ,  a  ) .  □ 


2.5  Breakdown  and  Bias  Optimality  of  the  Median 

For  discussions  of  the  breakdown  point  of  scale  estimates,  including  M-estimates,  see 

Hampel  et  al  (1986)  and  Huber  (1981).  Here  we  comment  only  on  an  M-estimate  of  scale 

based  on  jump  functions  x  with  a  6  (a,  a). 

a 

Let  e+  denote  the  supremum  of  all  £  for  which  s  (x,y  ),  given  by  (2.1)  with  /  e  Fj 

is  finite  when  y  =  «> ,  and  let  £"  denote  the  supremum  of  all  £  for  which  this  s  ( %,  y  )  is 

positive  when  y  =0.  Then  take  the  breakdown  point  (BP)  of  the  estimate  to  be 

BP  =  min  {£“,  £+) .  For  the  case  of  a  jump  function  x  >  it  follows  from  (2. 19)— (2. 19’)  that 

a 
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and  so 


e  =  F0(a) 
e+  =  1  -F0(a) 


BP  =  min{F0(a),  1-F0(a)} 


(2.21) 


(2.21’) 


Clearly  BP  £0.5  and  BP  =0.5  only  if  F0(a)  =  0.5.  In  this  case  a  =  a ^  is  the 
median  of  F0 ,  (2.2)  gives  b  =  bmed  =  0.5 ,  and  the  solution  of  (2.1)  is 


S  (  &  med  »  F  )  — 


Fo-'(j) 


(2.23) 


assuming  F  *(  y)  exists.  In  words:  the  only  jump  function  type  M-estimate  of  scale  with 
breakdown  point  y  is  the  median  functional,  standardized  by  the  median  of  F0  to  insure 
Fisher  consistency. 

Now  a  bias  optimal  estimate  of  the  type  given  by  Theorem  2.2  or  Corollary  2.2  is  of 
jump  function  type,  with  jump  location  a  0  in  ( a ,  a  ) .  For  e  <  y  we  will  seldom,  if  ever, 

have  BP  =  y  for  the  optimal  aQ.  Note  however  that  as  e  T  y , 
&  ~FqX  (£)  -* F0-1  (y)  and  a  =F0_1  (1-e) ->a0  =  F0_1  (y).  Thus  any  bias 
optimal  estimate  given  by  Theorem  2.2  or  Corollary  2.2  tends  to  the  median  estimate  (2.23) 
as  e  — ►  y .  Thus  the  median,  as  an  estimate  of  scale  of  a  positive  random  variable  with  a 

contamination  distribution,  simultaneously  enjoys  two  global  robustness  properties:  a 
maximal  breakdown  point  of  one-half  and  min-max  bias  optimality. 


•  .  *'■  *  •  *.*  ./ .  *  .  *  ■  *  -  -  •  •  •  .  •*  v*  .  *  »'%*•*•*  •  *  *.*  •  *  -  "  •’  -  ‘  v"  .*,  • 


- 15- 


3.  THE  EXPONENTIAL  AND  POSITIVE  NORMAL  DISTRIBUTIONS 

In  this  section  the  loss  function  /  ( s  s + )  =  max  { log  s  log  s  +  }  is  used. 

3.1  Exponential  Distribution 

Suppose  that  our  target  distribution  is  exponential  with  scale  parameter  5  ,  that  is 

f(x,s)  =  —  /o(-),  fo(x)  =  e~x 

s  s 

In  this  particular  case  s+(a)  and  s~(a)  (See  Section  2)  reduce  to 

»  ^ 

+/  \  1  ,  e~a-e 

s  ( a )  = - log 

a  1  -e 

a.  • 

,-(«)  =  l  +  i2Sil^) 


(3.1) 


(3.2) 

(3.3) 


for  a  e  (a ,  a  ) . 

We  notice  immediately  that  s~(a )  is  strictly  increasing  with  lims~(a)=l, 

a  -*o 

lim  s~(a)  =  0.  It  is  also  easy  to  check  that  the  derivative  of  s+(a)  is  positive  (see 

a  —>a 

Section 5  for  details),  so  that  s+(a)  is  strictly  increasing,  with  lims  +( a )  = «  and 

a  —>a 

lim 5 "(a)  =  log  (1  -2e)/log  (1  -e) .  Therefore  Corollary  2.2  is  in  force. 

a  — >a 


In  Table  la  we  show  values  of  the  optimal  a0 ,  along  with  log  s+(a0)  =  -  log  ~(a0) , 
l-s"(a0),and  j+(ao)-l  for  several  values  of  e.  Breakdown  points  and  efficiences  at 
the  nominal  model  are  also  given.  We  note  that  the  breakdown  points  of  the  optimal 
estimators  are  fairly  high  (at  least  0.46),  even  when  they  are  designed  for  contamination 
models  with  small  fractions  of  contamination ! 

For  the  sake  of  comparison  with  the  optimal  estimator,  Table  lb  displays  corresponding 
values  of  -logs",  log s  +  ,  1  -s~  and  s  +  -l  for  the  scaled  median  estimator 


Table  1  Min-Max  and  Median  Estimates  for  Exponential  Distribution 

(a)  Min-Max  Estimate 


e 

log  s  +(a  o ) 

1 

1 

X— s 

o 

i 

o 

Breakdown 

Point 

Efficiency 

0.10 

0.716 

0.159 

0.147 

0.173 

0.49 

0.49 

0.20 

0.739 

0.359 

0.302 

0.432 

0.48 

0.50 

0.30 

0.761 

0.632 

0.469 

0.882 

0.47 

0.51 

0.40 

0.773 

1.080 

0.661 

1.946 

0.46 

0.51 

0.45 

0.763 

1.530 

0.783 

3.618 

0.47 

0.48 

(b)  Scaled  Median  Estimate  ( a  =  .693) 


£ 

-log  s 

logs+ 

1  -s~ 

s+- 1 

Breakdown 

Point 

Efficiency 

0.10 

0.165 

0.157 

0.152 

0.170 

0.50 

0.48 

0.20 

0.389 

0.347 

0.322 

0.415 

0.50 

0.48 

0.30 

0.723 

0.592 

0.515 

0.807 

0.50 

0.48 

0.40 

1.335 

0.950 

0.737 

1.585 

0.50 

0.48 

0.45 

1.984 

1.241 

0.862 

2.459 

0.50 

0.48 

sn  =  med/  . 693.  While  the  scaled  median  is  actually  less  sensitive  to  outliers  than  the 
optimal  estimate,  it  is  sufficiently  more  sensitive  to  inliers  that  it  is  somewhat  dominated  by 
the  optimal  estimate  using  the  loss  max  { -logs-,  logs*} .  As  one  might  expect,  both 
estimates  are  more  sensitive  to  outliers  than  inliers  on  the  raw  scale.  Note  also  that  the 
asymptotic  efficiency  of  .48  for  the  scaled  median  at  the  nominal  model  is  only  slightly 
smaller  than  that  of  the  min-max  bias  estimates  displayed  in  Table  la.  In  summary  we  can 
state:  the  scaled  median  is  a  nearly  optimal  estimate  of  scale  in  terms  of  asymptotic  bias. 

Table  2  displays  similar  results  for  the  positive  normal  distribution,  whose  density  is 
f PN(x)  =  2<t>(x) ,  x  >0,  where  $(*)  is  the  standard  normal  density.  The  results  are  rather 
similar  to  those  for  the  exponential  distribution.  Again:  the  scaled  median  (in  this  case 
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medj. 6751 )  is  a  rather  good  approximation  to  the  optimal  bias-robust  estimate. 


Table  2  Min-Max  and  Median  Estimates  for  Positive  Normal  Distribution 

(a)  Min-Max  Estimate 

Breakdown 


e 

log  s+(a0) 

© 

jS 

* > 

1 

+ 

-—V 

A 

© 

w 

1 

Point 

Efficiency 

0.10 

0.700 

0.127 

0.120 

0.136 

0.48 

0.38 

0.20 

0.726 

0.284 

0.247 

0.329 

0.47 

0.40 

0.30 

0.750 

0.494 

0.390 

0.639 

0.45 

0.41 

0.40 

0.762 

0.844 

0.570 

1.325 

0.45 

0.42 

0.45 

0.746 

1.236 

0.710 

2.441 

0.46 

0.41 

(b)  Scaled  Median  Estimate  (a  = 

.675) 

e 

-log  s~ 

log  s+ 

1  -s~ 

j+-l 

Breakdown 

Point 

Efficiency 

' JL**!- ‘iC WlC  V  iVL 
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4.  MAXIMAL  BIAS  CURVES  AND  FINITE  SAMPLE  SIZE  RELEVANCE 

It  should  be  noted  that,  min-max  bias  optimality  results  aside,  the  calculation  of 
maximal  bias  curves  (i.e.,  plots  of  maximal  bias  of  a  given  estimate  for  each  fraction  e  of 
contamination,  versus  £ )  for  contamination  models  for  any  proposed  robust  estimate  is  a 
very  worthwhile  goal  (see  Sec.  2.7  of  Hampel  et  al,  1986).  It  was  a  pleasant  surprise  to 
discover  that  for  a  wide  range  of  estimation  problems  (in  addition  to  estimation  of  scale),  and 
types  of  estimate,  one  can  usually  obtain  an  analytic  expression  from  which  one  can 
calculate  the  maximal  bias  curves. 

For  example,  (2.9)  and  (2.10)  of  Theorem  2.1  lead  to  the  maximal  biases  (2.5)  and 
(2.6),  for  outliers  and  inliers,  respectively.  It  is  not  always  possible  to  express  the  inverse 
h  ~ 1  in  explicit  analytic  form  (e.g.,  it  is  possible  for  the  case  of  exponential  F0 ,  but  not  for 
the  positive  normal  F0  in  Section  3).  Nonetheless,  the  expression  (2.7)  for  hx(s)  is  nice 
enough  (as  are  analogous  expressions  for  other  problems  such  as  location,  regression,  etc.), 
that  one  can  always  solve  numerically  for  s+( x)  and  s~(x)  by  computing  hx(s)  for  a 

grid  of  s  values,  and  interpolating  to  match  with  — — -  and  — ,  respectively. 

1 -£  1  -£ 

We  have  done  this  for  the  following  two  estimators  in  the  case  of  the  positive  normal 
F0 :  (i)  The  median;  and  (ii)  Huber’s  M-estimate  of  scale  based  on 

fr2,  0<  r  £  t 

*(0 |(2f  ,>t 

The  results  are  shown  in  Figure  1  for  x=  1.5 ,  which  results  in  approximately  50%  efficiency 
for  the  Huber  estimate,  at  the  nominal  positive  normal  distribution  (where  the  scaled  median 
has  37%  efficiency).  The  Huber  estimate  is  much  more  sensitive  to  the  outliers  than  the 
median,  as  reflected  in  the  fact  that  B^b  >  B^d  for  all  e.  Furthermore,  the  Huber 
estimate  has  a  breakdown  point  toward  outlWs  of  only  .29,  (whereas  that  of  the  scaled 
median  is  .5 ).  On  the  other  hand  the  Huber  estimate  is  less  sensitive  than  the  median  to 
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inliers,  and  accordingly  for  all  e .  Also,  the  breakdown  point  of  the  Huber 

estimate  to  inliers  is  .71  (as  compared  with  .5  for  the  scaled  median). 

Finally,  one  should  be  concerned  about  the  relevance  of  an  asymptotic  min-max  bias 
theory  for  finite  sample  situations.  Here  one  is  naturally  interested  in  the  sample  size  n  (e) 
at  which  squared  bias  is  equal  to  the  variance.  One  can  get  a  rough  idea  of  what  n  (e)  will 
be  by  acting  as  if  the  asymptotic  bias  and  variance  projects  well  back  to  finite  sample  sizes. 

For  example,  consider  the  positive  bias  B  +(e)  =  s  +(e)  - 1  of  the  mix-max  scale 
estimate  for  the  exponential  F0  (see  Section  3).  This  bias  is  achieved  by  point  mass 
contamination  8„,  at  infinity.  The  corresponding  asymptotic  variance  is  easily  shown  to  be 

+  _  b  l~b 

( 1  -£)2oq  e~2s  a° 

j_ 

where  s+=s+(e),  a0  =  a0(e).  Some  values  of  n+(e)  =  [  V+(e)] 2 / S+(e)  are  shown  in 
Table  3. 


Table  3:  Sample  Size  n(e)=  [V+(e)]2/B+( e) 
for  Matching  Variance  and  Squared  Bias 
(Min-Max  Scale  Estimate  for  Exponential  F0 ) 


e 

.02 

.05 

.1 

.15 

.2 

n+(e) 

50 

20 

10 

7 

6 

Evidently,  the  asymptotic  theory  is  relevant  down  to  quite  small  sample  sizes  unless  the 


fraction  of  contamination  is  exceedingly  small.  More  precise  finite-sample  size  calculations 
should  be  carried  out  to  confirm  this. 
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5.  SCALE  FOR  SYMMETRIC  DISTRIBUTIONS  WITH  NUISANCE  LOCATION 
PARAMETER 


Suppose  now  that  our  observations  X,  are  not  restricted  to  being  positive,  and  have  a 


location-scale  family  distribution  =  F 


x-u. 


.  We  now  assume  that 


F={F:F  =  (1-e)Fq  +  eH,Fq  symmetric  } 


(5.0) 


and  H  is  again  any  distribution  function.  One  now  has  to  estimate  the  nuisance  location 

A 

parameter  p ,  and  so  let  p„  be  any  location  and  scale  equivariant  estimate  of  location. 
Then  the  M-estimate  of  scale  sn  is  given  by 


4  =  inf  i 


s  :  I  X 

l 


\Xi~tn  I 


£  b 


(5.1) 


where  x  is  as  in  Section  2.  The  corresponding  asymptotic  functional  is 


*  ( X  >  F  )  =  inf 


lX-p(F)| 

s 


dF  (x)  <,  b  .  ^ 


(5.2) 


A 

Here  p„  is  assumed  to  have  an  asymptotic  functional  representation  p(/r),  and  b  is 
given  by  (2.2).  Existence  of  a  unique  solution  s(x,F)e  (0, ««)  follows  under  (A  l)-( A3) 
and  finiteness  of  p(F),  just  as  in  Lemma  2.1.  Without  loss  of  generality  we  take  p(F0)  =  0 
and  s(x,F0)=l.  Then  p(F)  is  the  bias  in  estimating  p  and  s(x,F)-l  is  the  bias  in 
estimating  s  . 


Let  X  be  a  random  variable  with  distribution  Fx ,  and  let  F_x  denote  the 
distribution  of  -X  .  Then  most  p(F)  of  interest  will  satisfy  the  symmetry  property 

(LI)  P(F-x)  =  -P(F*). 
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Suppose  that  s  (X>Fx)  *s  given  by  (5.2),  with  x  ~FX  resulting  in  fi(Fx)<0.  Then  in 
view  of  (5.0)  and  (LI),  there  exists  F_x  in  F  with  \i(F_x  )  =  -H(Fy)  >  0  and 
s  ( X  *  F-x ) =  s  ( X » Fx) .  Thus,  it  suffices  under  LI  to  restrict  attention  to  the  sub-family 


F+  =  (Fe  F:  ^t(F)£  0}  . 

In  addition  we  will  use  the  assumption 

(L2)  For  all  Fe  F+,  p.(F)  £  |i<  <»  where  p  =  |i((  1  -e)F0  +  e8oo). 

REMARK 5.1:  Any  location  functional  |l (F)  with  breakdown  point  greater  than  e.such 
that  n(8,J  =  supf€  F.|i(F)  will  satisfy  (L2).  For  example  location  M-estimates  based  on 
bounded,  monotone  psi-functions  will  satisfy  (L2). 


Let 


h(s,t)  =  J“  X 


X  -t 


fo(x)dx 


(5.3) 


By  change  of  variable  we  have 

h(s,t)  =  5  JQ  x(*>  {/0(^ -t)+f0(xs  +  0}  dx  .  (5.4) 


Lemma  5.1:  Let  x  satisfy  (Al).  In  addition  suppose  that  the  density  /0  is  not  only 
symmetric,  but  also  decreasing  on  [  0, «) .  Then  for  each  fixed  s  >  0 ,  h  (s,t)  is 
increasing  in  t  on  [  0,  <») . 


Let 


^(s,F)  =  ( 1- e)h(s,n(F))+  ejx 


x-U(F) 


dH  (x) 


(5.5) 


and  let  $m(X)  and  $m(X)  denote  the  largest  and  smallest  values  of  s(x,F),  as  F 


ranges  over  F  +  .  Here  the  subscript  p.  denotes  dependence  on  the  form  of  the  location 
functional  p=|i(*)-  \^(s,F)  is  a  decreasing  function  of  s  ,  and  so  .j*(x)  is  achieved 
by  a  possibly  substochastic  contamination  distribution  H  which  makes  Xa(s ,F)  as  large 

r 

as  possible  for  s  >  1 ,  and  s~(x)  is  achieved  by  an  H  which  makes  (s ,  F)  as  small 

as  possible  for  s  <  1 .  Even  though  pfF)  is  now  involved,  it  follows  from  Lemma  5.1  that 

point  mass  contamination  at  infinity  achieves  s^(X).  and  point  mass  contamination  at  the 

origin  achieves  s  *(x) . 

- 1 

Let  h-  ( t )  denote  the  inverse  of  with  respect  to  the  first  argument,  with 

the  second  argument  fixed  at  p  =  p((  1  -e)F0  +e5«J  ,  and  define  /i  q  1  ( r )  similarly  in 
terms  of  h  ( s ,  0 ) . 


REMARK  5.2:  The  maximal  scale  s^(X)  depends  on  the  location  functional  p=|i(-  ) 
through  |i .  On  the  other  hand  the  minimal  scale  5  "( x )  is  independent  of  the  choice  of  the 
location  functional  (i  ( F )  which  is  why  we  denote  it  simply  s  "( x  )  • 

Since  the  median  minimizes  the  maximum  bias  (i  of  any  equivariant  location  estimate 
over  F*-  (Huber,  1964),  Lemma  5.1  gives  the  following  important  corollary. 

Corollary  5.1 :  The  median  minimizes  s^(X)  over  location  functionals  p=p(’) 
which  satisfy  LI  and  L2. 


The  results  of  Section  2.4  hinge  on  the  key  Lemma  2.3,  the  proof  of  which  relies  on  the 
hypothesis  that  ks(x)  =  fo(sx  )/fQ(x)  is  decreasing  for  s>  1,  and  increasing  for 
s  <  1 .  In  the  present  context  we  still  have  ks(x)  =  f0  (sx)/f0(x)  for  s  <  1 ,  but  for  s  >  1 
ks(  x)  is  replaced  by 


fo(sx~\imed)+f0(sx+\Lmed) 

k^M  =  - hM - 


(5.9) 


where  is  now  the  maximal  bias  of  the  median.  Unfortunately,  k  -  (x)  is  not 

decreasing  for  all  s  and  all  values  of  |i^,  and  this  complicates  matters  somewhat. 
However,  we  can  proceed  as  follows. 

First,  note  that  the  same  type  of  argument  used  in  the  proof  of  Theorem  2.2  shows  that 

there  is  an  optimal  jump  function  x  among  the  class  of  all  jump  functions  x  •  That  is, 

a*  a 

for  /  e  L, ,  /  =  1  or  /  =  2 ,  there  is  an  a  +  e  ( 0,  °°)  such  that 


L(a  )<l(s~(x  ),  5  +  (X  ))>  ae(0,oo). 


(5.10) 


Let  s  *  =  5  +  ( a  ) ,  s  =  s  (aj,  and  set 


kt(x)  = 


fo(x) 


(5.11) 


where  the  subscript  now  indicates  the  dependence  on  £  through  s  *  and  ji  ,  each  of 
which  depend  on  e.  Note  that  the  conclusion  of  Lemma  2.3  holds  when  kE(x)  is 
decreasing  (just  replace  fo(sx)/f0(x)  by  kE(x)  in  Jie  proof).  In  applications  there  will 
always  be  an  interval  [0,e0)  for  which  ke(x)  is  decreasing  for  £e  |0,e0).  The  normal 
distribution  provides  a  concrete  example  of  this,  as  we  see  shortly. 


The  next  theorem  gives  conditions  under  which  the  optimality  x  over  the  class  of 


all  jump  functions  extends  to  C . 
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Theorem5.2:  Let  a  be  as  in  (5.10),  so  that  X  is  optimal  over  all  jump  functions. 

a* 

Suppose  that  ke(x)  is  decreasing  and  let  /  e  L2.  If  .y+(a),  s“(a)  are  both  strictly 
increasing,  or  if  the  derivatives  of  s  +( a ) ,  s  ~(a )  are  non- vanishing  at  a  + ,  then 

L(a)=  min  /  (5_(x),^+(X))  • 

xec 


Proof:  Choose  any  C,  and  fix  b  corresponding  to  this  x >  namely  b-  EFox(X). 

Let  x  be  the  unique  jump  function  which  corresponds  to  this  particular  b  .  Let 

a 

hX^s*^~  h(s  turned)  for  the  given  X-  If  »  then  from  (5.7)  for  both 

X  and  x  .  and  the  monotonicity  of  h  ,\imed) ,  x  is  not  better  than  x  >  i-e-> 


b  -e 


s+ix)^  S+(X  )•  So,  suppose  that  hy(s+)<  - ,  i.e.,  suppose  x  is  strictly  better 

a,  *  1-e 

than  x  f°r  s+’  i-e  >  5+(X)<  s+  =  •s+(^*)-  We  will  show  that  then  x  must  be  worse 
a* 

than  x  for  s~ ,  and  hence  worse  than  x  for  s~ .  Since  kE(x)  is  decreasing,  the 


conclusion  of  Lemma  2.3  applies  at  the  point  s  =  s  * .  Thus,  the  jump  function  x  is 

a 

optimal  at  the  point  s  =  s  +  ,  and  so  s  +( a )  <,  s  +( x )  <  s  *  .  In  view  of  Corollary  2.2,  and 
the  optimality  of  x  we  have 


a 


* 


Si(**)=  8  max{g!(j  (a)),g2(^+(a)))  .  a  e  (0,oo) 

and  it  follows  that  s~(a)£  s~  For  the  particular  b  in  question  the  jump  function  x  is 

a 

optimal  for  all  s  <  1 ,  and  so  we  have 

s"(X)  £  s”(a)  £  s~  . 

Thus  X  is  as  good  as  any  x  s  C .  □ 


The  Normal  Distribution 


We  now  apply  this  general  result  to  the  case  of  the  normal  distribution  and  the  loss 
function  l(s~,  j+)=  max  {-log  s~,  log  s  +} . 

The  optimal  value  of  a  m  is  obtained  for  each  e  by  minimizing 

max  {-log  j"(a),log5+(a)}  for  ae(a,a),  where  .s+(a)  is  given  by  (5.7)  with 

X  =  X  and  ,  and  s'(a)  is  given  by  (5.8).  This  cannot  be  done  analytically, 

a 

since  h  ( • ,  t )  given  by  (5.4)  does  not  admit  a  closed  form  inverse  when  /0  is  normal.  We 
determined  by  numerical  search  for  e=  .05,  .5(.05),  evaluated  the 

corresponding  values  s  +(a *),s~(a*)  and  =ltm«/(e).  These  are  displayed  in 

Table  5.1a  for  e  =  .05,  .35(  .05) .  With  the  help  of  Lemma  6.1  (see  end  of  Section  6)  we 
have  numerically  verified  that  the  conditions  of  Theorem  5.2  hold,  and  therefore  x  is 

optimal  for  these  value  of  e  . 

Based  on  further  numerical  checks,  we  conjecture  that  x  is  optimal  for  all 

£€  (0,  .35).  On  the  other  hand  a  calculation  showed  that  ke(x)  is  not  monotone  for 

e=  .4,  and  thus  we  cannot  conclude  that  x  is  optimal  for  all  values  of  ee  (0,  .5),  at 

a * 

least  not  by  the  current  method  of  proof.  The  question  of  optimality  of  x  for  the  full 
range  of  e  is  (0,  .5)  remains  an  open  problem. 

The  min-max  bias  values  log  s  +( a  *  )  =  -  log  s  “( a  *  )  are  shown  in  Table  4a,  as  are  the 
negative  and  positive  biases  l-s^a^)  and  s +( a  ^ )  -  1  on  the  raw  scale.  Breakdown 
points  and  efficiences  are  also  displayed. 

As  in  the  case  of  the  solutions  for  exponential  and  positive  normal  distributions  in 
Section  3,  we  find  that  a  m  is  quite  insensitive  to  the  value  of  e ,  and  not  too  different  from 
those  for  the  positive  normal  distribution.  However,  the  actual  min-max  biases  log  s+(a  ) 
(and  also  the  corresponding  row  biases)  are  substantially  higher,  as  one  might  expect,  due  to 


! 


the  nontrivial  bias  of  the  median  as  centering  functional. 

Table  4b  displays  similar  quantities  for  the  scaled  median-absolute  deviation  about  the 
median  (MADM)  estimate.  The  comparison  of  Tables  4a  and  4b  shows  that  even  though  the 
scaled  MADM  is  not  optimal  for  the  given  loss  function  and  values  of  e,  it  is  strikingly 
close  to  optimal  for  the  range  of  e  values  considered  (the  performance  of  the  scaled  MADM 
is  much  nearer  to  that  of  the  optimal  estimate  than  was  that  of  the  scaled  median  for  the 
positive  normal  distribution  treated  in  Section  3.2).  Except  for  e=  .35 ,  the  common  entries 
of  Tables  4a  and  4b  agree  to  at  least  two  decimal  places,  and  at  e=  .35  the  differences  are 
only  about  .01 .  The  breakdown  point  of  the  min-max  estimates  round  to  .500  for  all  e 
values  shown.  In  effect  a  single  Table  would  suffice,  and  we  are  led  to  assert:  For  all 
practical  purposes  the  scaled  MADM  is  the  min-max  bias  estimate  for  e  =  .05,  .35  ( .05) , 
(and  probably  for  all  £6  (0,  .35  ) ). 
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Table  4  Normal  Distribution  with  Location  Unknown 
(a)  Min-Max  Estimate 


_  Breakdown 

e  Vmed  a*  log^d*)  l-s'C**)  )- 1  Point  EFF 


6.  PROOFS  OF  RESULTS 


Proof  of  Lemma  2.1 

Proof:  For  F  e  F ,  we  have 

Ms)=  J X(  ~)dF(,x)  =  (l-e)Jx(  j)dF0(*)  +  eJx(  j)dH(x) 

Since  for  any  distribution  function  H  ,  including  the  point  mass  at  infinity,  we  have 
lim s^00X(s)<,e<b  ,  it  suffices  to  show  that  lim,^. X.(s)  > b  .  Since 

oo 

X(s)>(l-£)  j  x(~ )dF0(x)  for  any  H  ,  with  equality  when  H  is  concentrated  at  the 
o  s 

origin, 

oo 

lim^o-Ms)  >  ( 1-e) lim,^^  jx(~)dFo(x)  =  (l-e)>Z?  . 

o  s 

Thus  s  ( F ,  x )  6  ( 0,  oo)  for  all  H  .  □ 

Proof  of  Lemma  2.2 

Proof:  We’ll  show  that  for  all  F  e  F  there  exist  Fl,F2,eFl  such  that 
s  (X’F)^S  (X»^2)-  Let  Xs  C  and  s=s(x,F)  be  defined  as  in  (2.1),  with 

F  =(1  -e)F0  +  eH  . 

If  eH  {  X(X/s~) }  =  1  for  some  s'  <  s  then  X(x/S  )  =  1  a.s.  [H  ]  and  there  exists  y  e  R 
such  that  X  (y/s  )  ~  *  •  Let  F2  =  ( 1  -G  )F0  +  e  5y  ;  for  all  s'  £  s  we  have 

EFi{x(X/s')}  =  (1  -e)hx(s')  +  e  =  EF{x(X/s')}  >  b, 

therefore  s  (F2  ,  X)^  s  ■  If  EH  {x(X/s ')  }  <  1  for  some  0  <s'<s  (and  then  for  all 
s'  £s'£s  ),  let  y  €  R  be  such  that  x(y/s  )  >  eh  i.X(X/s~)  }  and  let  F2  be  as  defined 


for  some  s  <  s '  £  s  ,  by  continuity  of  h  x  we  have 
£f,{x(*/*)}  =  (l-e)/tx(j)  +  ex(yAO  >  (1 — e) /»x(^ ')  +  eEh{x(X/s')}  >  b 
Therefore  s  (x  ,F2)  £  s  . 

On  the  other  hand,  let  F\  =  ( 1  -  e )  F0  +  e  50 .  For  all  s  >  s  we  have 

EF[{x(X/s)}  =  (1  -e)hx(s)  £  (1  -e)hx(s)  +  eEh{x(X/s)}  =  EF{x(.X/s )}  £  b 

hence  5  (x  ,  F,  )  =  inf  {  s  :  E/r,{x(X/s)}}  £  s  •  □ 

Proof  of  Theorem  2.1 

For  any  y  we  have,  by  definition  of  sy 

s<s  =>  ( l-e)/i(j  )  +  e-b  £  ( 1  -z)h(s  )  +  ex(7) -b  £  0 

7  S 

Thus,  by  continuity  of  h  ( s  )  we  have 

h(sy)  >  .  (6 

1  —  E 

On  the  other  hand,  again  by  definition  of  sy  ,  we  have 

(l-e)/i(^)  £  (l-e)A(sy)  +  ex(^-)  £  b  (6. 

Sy 

from  (6.1)  and  (6.2)  follows 

£  h(sy)  <. 


b  -e 
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h~\- -r-)  <■  sy  Z  h~\ 44)- 


1-e 


1-e 


For  y  =  0,  Uk  ieft-hand  inequality  becomes  an  equality.  Now  note  that  sy  satisfies  the 
monotonicity  property  syi  £  syj  when  ylky2.  Thus  if  yn  is  a  sequence  of  values  tending 
to  infinity,  the  limit  I  =  lim„_,^  sy*  exists.  We  claim  that  for  sy  =  s,  the  right  hand 
inequality  in  (2.1 1)  becomes  an  equality.  For  suppose 

.-i,  b-e. 


■  -1  .  . 

1  <  *  <T7>- 


Then 


h(s  )  > 


b-  e 
1-e 


and  we  can  choose  8  >  0  and  y  0  sufficiently  large  that 


(\-e)h(s  )  +  ex 
Contradicting  sy  £  s  .  □ 


n 

I 


-b  t  (l-e)A(*)  +  e(l-8)-fc  >  0 


Proof  of  Lemma  2.4 

Let  s  >  1 .  For  all  x  £  0  we  have 


d_ 

dx 


fo(sx) 

fo(x) 


<  0 


if  and  only  if 


/o  («) 
/o(«) 


<  - 


fo  (*) 
/o(*> 


The  last  inequality  follows  since  -  fo  (x)/f0(x)  is  non-negative  and  increasing.  For  s  <  1 


all  the  reverse  inequalities  hold.  G 


Proof  that  —s  +  (a )  >  0 
da 


-7 ~s+(a)  = 
da 


_  I  a  e~a  .  /  e  *-e 


e  -e 


■♦MV?) 


/a2  2  0 


if  and  only  if 


A  le~a 


log  ( a  -e)  £  y(a)  = 


e~a-E 


+  log  (e~a-e) 


The  last  inequality  follows  because  y(0)  =  log  ( 1  -  e)  and 


-j-y(a)  =  a  E 
da 


e~a-E 


e  a-E 


-1 


£  0 


Proof  of  Lemma  5.1 

Proof:  It  suffices  to  consider  the  case  s  =  1 .  Extend  the  domain  of  x  to  R  by  setting 

1 1  +■  1 2 

X(-0  =  X('),f  £  0.  Set  A  =  — - — , 0 <,  t  j <,  1 2 <  00 .  Then 

L„lX(*  -l2)-X(x 

=  CjXix-'iy-Zd-'Olfoi*)*  +  tx(* -*2)"X(* -h)]/o(x)dx 

=  j~[x(fi-y)-x(‘2-y)]fo('i+'2-y)dy  +  j~  lx(y-'2)~x(y -'Olfo(y)dy 
=  JA  lx(y  -h)-x(y -h)Ufo(y)-fo(y -2A)]dy 
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Proof  of  Theorem  5.1 


Proof:  By  (LI)  and  the  Lemma  5.1  we  have  for  all  s  >  0 


and  so 


/i(s,p(F))  £  Mj.iO  v  Fe  F+ 


Xu(j,F)  £  ( \-e)h  (.s,p.)  +  e 


with  the  right-hand  side  achieved  when  H  =  8^,  the  point  mass  at  infinity.  Equating  the 
right-hand  side  to  b  yields  5.7.  On  the  other  hand  for  all  s  >  0  we  also  have 

\(s,F)2  (s ,0)  +  F  6  F+ 

with  the  right-hand  side  achieved  when  H  =  5o,  the  point  mass  at  the  origin.  Now,  equating 
the  right-hand  side  to  b  gives  (5.8).  □ 


Statement  and  Proof  of  Lemma  6.1 


The  following  notation  is  needed  for  Lemma  6.1,  below: 


Let  t  =  su  and  set 


A  (s ,  t,  b  j,  b2)  =  (*2-l)[l+e  2xbl-2tb2e  ‘b']-2  t2e  'b] 


A0(s,t)  =  A  {s,t,  0,  -3-) 


A  1  ( s ,  t )  —  .4  (s ,  t ,  ,  , ) 


A 2 ( •T >  t )  -  A  (s ,  t ,  ^ ,  2’) 


A3(s,t)  =  A  f.) 


a  •  .  *  «  *  .  •  .  *  _  *  ,  »  ,  *  -  ■  fl  •  •  *  «  *  t  "  «  *«•*  '  a  *  •  *  *  4  •  *  •  * 


WWW 
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A4(s,t)  »  A(*fr,^,l) 


Lemma  6.1:  Suppose  that 


and 


s  ( s-u )  >  1 


Then 


min  A:(s,t)  >  0 

0  <  7  S  4  1 


h  ( x,s,u ) 

is  a  decreasing  function  of  x  . 


ty(sx+u)+  §(sx-u) 
<Hx) 


Proof: 


h(x,s,u)  =  e  2  (ew“+e  sxu) 


and 


~h(x,s,u)=  e  2  \-;c  (s2-\)(e~au+esxu)  ~  su  e  xx“+$we5*“] 


Then 


—  h  (x, x,  u)  £  0 
ox 


su  £  x  (s 2-  1)(  l+e~2sux)  +  su  e  2sux  (6.1) 


The  last  inequality  holds  for  x  £  1  since,  by  hypothesis 

x  (a2-  1)(  l+e-2i“*)  +  su  e~2sux  £  (s2-  1)£  su  . 


If  x  =  0  then  equality  holds.  Therefore,  we  only  need  to  prove  that  right-hand  side  of  (6.1) 
holds  when  0<  x  <  1.  Set  8(x)  =  x(i2-l)(l+e_2tt)+re"2lx; 
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b'(x)  =  (s2-  1)[  1+  e~2tx -  x  2t  e~2tx]-  2  t2e~2tx 

S\x)  £  min  A :  >  0 

1 

and  the  lemma  follows.  □ 
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